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Teleradiology systems for rendering and visualizing remotely-located volume data sets 

Background of the Invention 

The present invention generally relates to teleradiology systems, specifically to 
teleradiology systems with remote volume data rendering and visualization capability. 

Teleradiology is a means of electronically transmitting radiographic patient images and 
consultative text from one location to another. Teleradiology systems have been widely used by 
healthcare providers to expand the geographic and/or time coverage of their service, thereby 
achieving efficiency and utilization of healthcare professionals (e.g., radiologists) with specialty 
and subspecialty training and skills, resulting in improved healthcare service quality, delivery 
time, and reduced cost. 

Existing teleradiology systems have been designed for, and are only capable of, 
transmitting two-dimensional (2D) images in a predetermined order, similar to a fax machine, 
faxing page by page in a predetermined order. Prior art includes US patents 47485 1 1 by Nichols 
et al, 5291401 by Robinson, and many related patents. None of them is optimized for volume 
data rendering and study. 

Data rendering refers to the process of converting data into visual forms so that the 
information in the data can be understood and interpreted. These visual forms are usually shown 
on a two-dimensional monitor, film or even paper. Data visualization refers to the process of 
displaying and studying the rendering results. Two-dimensional data rendering and visualization 
is straightforward, as a 2D (MxN) data array can be readily presented as a 2D (MxN) image 
which can be displayed (e.g., on a monitor) or printed (e.g., on a film or paper). However, 
visualizing data of more than two-dimensions is a much more complex task. We refer to a data 
set with more than two dimensions as volume data. 

Visxializing volume data requires volume data rendering methods. In general, a volume 
data rendering method reduces or converts an original volume data set into a synthesized data set 
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of different forms, i.e., with reduced dimensions and with different data attributes. For example, 
one method of 3D volmne data rendering is called Multi-Planer Reformation (MPR), which is 
derived from the data within a slice of the 3D data "cube" by averaging the data along the 
direction perpendicular to the slice, hi this way, MPR reduces 3D data into a 2D image, 
presenting averaged data values in the sUce. As the rendering parameters (e.g., the locations, 
orientations, and thickness of the sUce) change, different 2D images (averaged data values) of the 
3D dataset are obtained. With MPR, one can view images of any oblique slice in addition to 
conventional horizontal slices. Another method of volume data rendering is called Maximum 
Litensity Projection (MIP), where the intensity of each pixel in the MIP image is the maximum 
intensity encountered in the 3D dataset along each of the parallel or divergent paths defined by 
viewpoint. Besides MPR and MIP, volume data rendering methods of medical interest also 
include surface rendering and volume rendering, as well as many variations and / or 
combinations of these methods. For technical details of these data rendering methods, reference 
may be made to the review article, "3D displays for computed tomography", by Sandy Napel, p. 
603-626, in the book entitled "Medical CT and Ultrasound: current technology and applications" 
published by Advanced Medical Publishing, 1995. 

Medical image acquisition techniques include X-ray, Computed Tomography (CT), 
Magnetic Resonance (MR), UltraSound (US), and Nuclear Medicine, Nuclear Medicine further 
includes Single Photon Emission Computed Tomography (SPECT) and Position Emission 
Tomography (PET). 

Li modem medical diagnosis and treatment planning, acquisition of volume data becomes 
a rule rather than an exception. Thus, volume data rendering and visualization methods have 
become essential methods, in addition to the traditional slice-by-slice 2D image studies. For 
example, the de facto standard for CT angiography image display is MIP, which results in a 2D 
image highlighting the vascular structures. The volume data rendering result is usixally obtained 
by interactively adjusting the rendering parameters, such as the viewpoint (i.e., the orientation), 
the spatial region and/or the value range of interest of the volume data. 
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There are many volxime data rendering / visualization systems (including software and 
hardware). Prior art includes US patent 4737921 by Goldwasser et al, 5649173 by Lentz, and 
many related patents. In order to improve the graphics performance, the current volume data 
rendering / visualization systems have been designed as local dedicated systems, rather than as 
network based systems. 

Currently, volume data rendering and visualization can only be done when the data to be 
rendered as well as the required rendering / visualization software and hardware are resided in 
the computer which is used to perform this task. If a user wants to obtain the volume data 
rendering result for a remotely located data set, he/she has to 1) transmit the entire volume data 
set from the remote location to his local computer via a network; 2) generate the rendering result 
from the local copy of the data and display the result, using the rendering / visualization software 
and hardware installed on his local computer. This approach, referred to as the two-step (i.e., 
transmitting and rendering / visualizing) approach, is often impractical and undesirable for the 
following reasons: 

1) This approach requires transmitting a large volume data set (e.g., 150 MB in a CT 
angiography study) over a network, which frequently is not practical for even normal 
networks (such as, the Ethernet) available in a hospital setting. It is even less practical for a 
direct dial-up (from home) using a telephone line with a modem. 

2) This approach causes a long initial delay because it takes a long time to transmit a large data 
set over a network, and the rendering and study caimot be started until transmission of the 
entire data set is completed. This delays the delivery of healthcare service. 

3) This approach is costly because performing volume data rendering / visuaUzation this way 
imposes stringent requirements on the network as well as the hardware (e.g., memory, 
storage, and processing power) and software (special for volume data rendering / 
visualization) of the user's local computer. 

4) This approach, because of the high cost, cannot be deployed in a large scale, and therefore 
cannot serve as a healthcare enterprise-wide image distribution solution. 
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5) This approach cannot provide ubiquitous access and distribution of images to the points of 
the user's choice, as it can only provide image access via limited designated points of access. 

6) Medical images are not used in a vacuum. Clinicians integrate the information derived from 
imaging studies with other clinical data (such as ECG, the blood pressure, the patient medical 
history) in order to make patient management decisions. What the clinician requires is 
ubiquitous access of the so-called electronic medical record, which integrates both image data 
and other clinical data. The two-step approach, due to its high cost and limited fixed access 
points, is not a suitable image distribution method for the electronic medical record. 

7) This approach requires generating local copies of the patient data to be studied, which is 
often undesirable for patient data management. 

Though solving above problems has substantial commercial benefits, no satisfactory 
solution exists that allows healthcare providers to render and study remotely located volume 
patient data. 

Rendering and visualizing data generated by a remotely located scientific instrument or 
supercomputer has been studied for several years. Prior art includes US patent 5432871 by 
Novik and many related patents. Also reference may be made to "Data and VisuaUzation 
Corridors: Report on the 1998 DVC Workshop Series" by P.H. Smith & J. van Rosendale, 
California Institute of Technology Technical Report CACR - 164 September 1998. The 
applications taught hereby distinctly differ from teleradiology applications in the following 
aspects. 1) The objects to be studied are fimdamentally different - patient data versus scientific 
measurements and computations, requiring different rendering / visualization methods as well as 
different user interactions / interfaces. 2) Teleradiology applications have imique requirements in 
regard to real-time interactivity and image fidelity. 3) Teleradiology applications require unique 
attentions to data security (including patient privacy) and data integrity as well as other medical 
and legal issues. 4) Teleradiology applications require a unique image distribution solution for 
medical image data and the electronic medical record that is suitable for large scale (e.g.. 
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healthcare enterprise-wide) deployment and that is fiiUy integrated with medical image data 
source and data management. 

Summary of the Invention 

This invention provides a method and apparatus that allow healthcare providers (e.g., 
radiologists, other physicians, and supporting staffs) to render and study remotely located volume 
patient data at the locations of their choices. The capability of rendering / visualizing remotely 
located volume data only becomes available by fully integrating data transmission and volume 
data rendering functionalities currently supported by two types of products, i.e., teleradiology 
systems and volume data rendering / visualization systems. 

Objects and Advantages of the Invention 

An object of the invention is to develop methods and apparatus that allow healthcare 
providers (e.g., radiologists, other physicians, and supporting staffs) to render and study remotely 
located patient data at the locations of their choices. 

Another object of the invention is to develop methods and apparatus of teleradiology that 
allows rendering and studying of remotely located patient volume data without transmitting the 
entire data to the user's local computer. 

Another object of the invention is to develop a secure cost-effective healthcare enterprise- 
wide solution for data rendering and visualization, and for image data distribution. 

Another object of the invention is to provide a solution to further integrate (combine) 
results from different rendering results, from different rendering methods, from different data sets 
(regardless of whether they are locally or remotely located), and/or, from different image data 
acquisition methods. 

Another object of the invention is to develop methods and apparatus for data rendering 
and visualization that efficiently utilizes the high-power computer hardware and/or software at 
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remote locations and alleviates the burden on the network as well as on the user's local computer 
(hardware and/or software). 

Another object of the invention is to develop methods and apparatus that allows software 
to be centrally installed and managed and to be provided to the user's local computer on an as- 
needed basis. Furthermore, the software can automatically adjust its configuration based on the 
user input and/or the configuration of the user's local computer and network. 

The teleradiology system of the invention provides a healthcare enterprise-wide solution 
for rendering and visualization of a remotely located data. It substantially overcomes problems 
of the prior art as described above. In particular, it is extremely cost-effective, ubiquitously 
accessible, secure and flexible. The teleradiology system of the invention will improve the 
accessibility, utilization, and therefore applications, of data (in particular, volume data) rendering 
and visualization in medicine. 

These and further objects and advantages of the invention will become apparent from the 
ensuing specification, taken together with the accompanying drawings. 

Description of the Drawings 

Fig, 1 is a schematic diagram illustrating principal elements of the teleradiology system 
with remote volume data rendering / visualization capability. 

Fig. 2 is a schematic diagram illustrating principal elements of current (prior art) 
teleradiology systems. 

Detailed Description of the Preferred Embodiment 

With reference to Fig. 1, the preferred embodiment of the teleradiology system of the 
invention is comprised of a data transmitting station 100, a receiving station 300, and a network 
(or a data transmission channel) 200 connecting transmitting station 100 and receiving station 
300. A data security (system) 34 extends into transmitting station 100, receiving station 300 and 
network 200. 
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Receiving station 300 comprises a data receiver 26, a send request 22, a user interface 32, 
a data decompressor 28, a display system 30, a central processing system 24, and, data security 
34. Transmitting station 1 00 comprises a data transmitter 16, a receive request 20, a data 
compressor 14, a volume data rendering generator 12, a central processing system 18, and, data 
security 34. 

Receiving station 300 is controlled by a user 400 and is typically located at the healthcare 
professional's office or home. Transmitting station 100 is usually located proximate to an image 
data source 10 (e.g., proximate to image database and/or archiving of a Radiology department). 
In some cases, image data source 10 may be included in transmitting station 100. 

In a preferred operation, user 400 via user interface 32 specifies, one at a time, 1) at least 
one image data set to be visualized; 2) at least one data rendering method to be used, 3) the 
rendering parameters used by each rendering method, and 4) the data transmission parameters for 
controlling data transmission over network 200. Central processing system 24 on receiving 
station 300 takes and validates the user request. Central processing system 24 then issues the 
request, v^hich is sent via send request 22 to transmitting station 100 through network 200. 
Central processing system 18 on transmitting station 100 receive the request via receive request 
20. Coordinated by central processing system 18, volume data rendering generator 12 accesses 
from image data source 10 the image data set which the user has specified, and then generates the 
data rendering result based on the data rendering method and parameters which the user has 
specified. The rendering result is usually a 2D image, much smaller in size than the original data 
set. Data compressor 14 further compresses the result and other parameters based on data 
transmission parameters which the user has specified. Then, data transmitter 16 on transmitting 
station 100 transmits the compressed data to data receiver 26 on receiving station 300 via 
network 200 based on data transmission parameters which the user has specified. On receiving 
station 300 and coordinated by central processing system 24, data decompressor 28 decompresses 
(or restores) the rendering result. (The central processing system 24 may also perform fiirther 
image processing and operations.) Display system 30 displays the result (the image) and other 
parameters on user interface 32. Via user interface 32, user 400 can fiirther modify 1) the image 



7 



data set to be visualized, 2) the data rendering method to be used, 3) the rendering parameters 
used, and 4) the data transmission parameters used. This process goes on until a satisfactory 
rendering and visualization result is obtained. 

With a well-designed teleradiology system, the response time from a user request to the 
display of the required result is very short and can be ignored or tolerated. Thus, the user can 
interactively control data rendering as v^ell as transmission, and visualize the rendering result in 
"real-time". Thus, the user can have virtually the same access to the remotely located volume 
data that he would have if it were the user's computer. 

For comparison, Fig. 2 shows the principal elements of current (prior art) teleradiology 
systems. The elements in Fig. 2 that correspond to those in Fig. 1 are annotated with the same 
numbers as in Fig. 1, suffixed by A. The suffix is ignored for network (200), user (400), and 
image data source (10). 

The teleradiology system of the invention (Fig. 1) provides a truly integrated functionality 
of data transmission of current teleradiology systems and volume data rendering and 
visualization of current volume data rendering / visualization systems. This integration represents 
a fundamental change for both teleradiology systems and volume data rendering / visualization 
systems. For current teleradiology systems, this integration represents a change from the image 
(2D data) based design to the volume data based design and, consequently, requires special 
designs in volume data rendering generation (12), rendering display (30), and rendering control 
(i.e., user interface 32). For current volume data rendering / visualization systems, this 
integration represents a change from the local dedicated system design to network based system 
design and, consequently, requires special designs in data transmission (16,26,20,22), data 
compression (14) / decompression (28), data security (34), and transmission control (i.e., user 
interface 32). The fundamental change required may explain why this new teleradiology system 
has not been proposed imtil now even though both teleradiology systems and volume data 
rendering / visualization systems have existed for a decade. 
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Volume Data Rendering and Visualization 



Volume data rendering and visualization is a well-established field. There are many 
volume data rendering / visualization systems for medical appUcations. The data rendering 
methods of medical interest include multi-planer reformation, maximum intensity projection, 
surface rendering, volume rendering, as well as many variations and / or combinations of these 
methods. The rendering parameters include the viewpoint (i.e., the orientation), the spatial region 
and the value range (e.g., controlled by thresholds) of the data to be rendered. Volume data 
rendering in medical applications also relies on image processing tools and data editing tools to 
select spatial regions of the data set to be rendered (e.g., to exclude the bone structures) and to 
highlight the structure of interest (e.g., the vascular tree). (For more details on volume data 
rendering and visualization implementation including software implementation, reference may be 
made to "The Visualization Toolkit - An Object-Oriented Approach to 3D Graphics 2"** 
edition, by Will Schroeder, Ken Martin, Bill Lorensen, published by Prentice Hall PTR, 1998.) 

Volume data rendering generator and display system 

The data rendering methods cited above are usually computationally intensive. They are 
implemented on volume data rendering generator 12 (Fig. 1). Volume data rendering generator 
12 may be implemented on a general-purpose computer, or on a high-performance dedicated 
computer or computing board (or card, unit) optimized for rendering generation. Similarly, 
display system 30 on receiving station 300 may be implemented on a general-purpose display 
system available on typical computers, or on a high-performance dedicated display system. 
Using high-performance dedicated systems will improve the data rendering and display speed 
and therefore the response time and the level of interactivity of the teleradiology system. On the 
other hand, using general-purpose systems will widen the applicability of this system. (US patent 
5649173, for example, teaches recent developments regarding graphic computers.) As a 
preferred tradeoff, volume data rendering generator 12 is implemented on a high-performance 
dedicated rendering board, while display system 30 is implemented on a general purpose display 
system available on typical computers. 
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User interface 



User interface 32A of current teleradiology systems (Fig, 2) only allows transmitting and 
displaying 2D images and other display parameters (e.g., display window parameters). In 
contrast, user interface 32 of the teleradiology system of the invention (Fig. 1) can, in addition, 
control rendering and transmission of a volume data set, and display the rendering results and 
rendering parameters. Note that volume data rendering results are typically in different forms 
from the original volume image data which these results are generated from. In terms of volvime 
data rendering and visualization, the design and ftmctionality of user interface 32 of the 
teleradiology system of the invention is similar to that of the current volume data rendering / 
visualization systems. These design and functionality are well established. (Many vendors' 
products, e.g., the Advantage Windows product made by General Electric Company, can be used 
as references.) In particular, user 400 can, via user interface 32, adjust rendering parameters 
(e.g., viewpoint as well as spatial region and value range of the data to be rendered) and other 
settings. The techniques for adjusting these parameters and settings include 1) using preset 
protocols for some typical settings; 2) inputting a specific setting with a keyboard, a mouse 
and/or other input devices; and/or 3) interactive navigation using a mouse, a trackball, a joystick, 
a keyboard and/or other navigating devices. In particular, user 400 can, via user interface 32, 
edit (including process) patient data (e.g., remove the bone structures) in a manner similar to the 
current volume data rendering / visualization systems. With the teleradiology system of the 
invention, user 400 can, via user interface 32, define and adjust data rendering methods and 
parameters, control what is to be rendered, transmitted and visuaUzed next, and eventually obtain 
the final rendering result. The user interface 32A of current teleradiology systems (Fig. 2) lacks 
these ftinctionalities of volume data rendering control and display as well as 'on-demand' 
transmission control. 

With the above descriptions on system components, rendering methods, volxmie data 
rendering generator, general/special rendering and display hardware, rendering and visualization 
software, as well as user interface design and ftmctionality, implementing the volume data 
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rendering and visualization aspects of the teleradiology system of the invention should be clear to 
one with ordinary skill in the volume data rendering / visualization field. 

Data Transmission 

Data transmission is a well-established field. Transmission of medical image data over 
networks has been widely utilized in teleradiology. Many teleradiology systems are cxorrently 
available. Teleradiology systems require careful consideration in data transmission media 
(concerning 200) and protocol (concerning 16,26,20,22 and 32), data compression (conceming 
14, 28 and 32), data security (34 and 32), integration with image data source and data 
management (conceming 10 and 32). 

Transmission media and protocol 

For the teleradiology system of the mvention, the preferred transmission media (i.e., 
network 200) may be an intranet, the internet (including the intemet2) or via a direct dial-up 
using a telephone line with a modem. The preferred data transmission protocol (for components 
1 6, 26, 20, 22) is the standard TCP/IP. Furthermore, for some transmission media (e.g., the 
intemet2), user 400 can control certain aspects (e.g., the priority level, the speed) of data 
transmission by selecting transmission parameters via user interface 32. These should be well 
known to one with ordinary skill in the network communication field. 

Data compression / decompression 

Data compression is a technique for densely packaging the data to be transmitted to 
efficiently utiUze a given bandwidth of network 200 during transmission. This operation is done 
by data compressor 14 on transmitting station 100. After transmission of compressed data to 
receiving station 300, data decompressor 28 restores the compressed data in a format ready to be 
used. The data compressor 14 and decompressor 28 can be implemented either on dedicated 
processors for improved response speed or on general propose processors for wide applicability. 
The wavelet compression / decompression — the de facto standard for data compression ~ is used 
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on the teleradiology system of the invention as a preferred method. (For technical details on 
data compression in general and wavelet compression in particular, reference may be made to the 
book "Wavelets and Subband Coding" by Martin Vetterli and Jelena Kovacevic, published by 
Prentice Hall, 1995.) Specifically, in one embodiment, user 400 can select data compression and 
transmission parameters via user interface 32. In another embodiment, these selections are done 
automatically by the teleradiology system based on the system configuration and the data to be 
transmitted. For example, the compression method selected can be lossless (i.e., the compressed 
data can be fiiUy restored) or lossy (i.e., the compressed data can only be partially restored). The 
attainable data compression ratio is about 3:1 for lossless compression and much higher for lossy 
compression. The data compression ratio represents a tradeoflF of preserving image fidelity (with 
less compression) versus increasing transmission speed (with more compression). Furthermore, 
transmitted images can also be refined progressively. Due to medical and legal considerations, 
the teleradiology system of the invention provides lossless and virtually lossless compressions to 
avoid misdiagnosis. It also provides progressive refinement for improved interactivity. The 
image compression / decompression techniques used for the teleradiology system of the 
invention are similar to that for existing teleradiology systems (i.e., 14A, 28A and 32A in Fig. 2). 

Medical image data source and management 

The teleradiology system of the invention may be readily integrated with medical image 
data source 10. In particular, medical image data are stored in the Digital Imaging 
communications in Medicine (DICOM) standards. (For details on DICOM, refer to Digital 
Imaging Communication in Medicine, Version 3.1. Rosslyn, VA: National Electrical 
Manufacturers Association (NEMA) Standards Publication No. 300-1997, 1997.) DICOM is a 
hierarchical approach to the storage and commimication of medical image data. The patient is 
the top level of this hierarchy. A patient makes visits to a medical service provider, who 
performs studies concerning this patient. Studies concerning a given patient are composed of 
study components (e.g., physician's notes concerning the patient, patient identification 
information, administrative data) and series. Series are in turn composed of radiological images 
and other related diagnostic information concerning these images. With appropriate access 
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privileges and via user interface 32, the teleradiology system of the invention is able to search 
image data source 10 on the basis of a patient, a study, a series, or some combination thereof. It 
is able to save the studies on receiving station 300 and/or transmitting station 100 for fiiture 
viewing. Furthermore, it is able to capture the consultation messages. In terms of integration 
with image data source and patient data management, the teleradiology system of the invention is 
similar to existing teleradiology systems. 

Data security and management 

Another medical and legal concern of a teleradiology system is its ability to protect 
patient privacy and data security. Data security 34 includes the security measures for 
authentication (i.e., proof of identity), access control, confidentiality, and data integrity. (For 
detailed technical descriptions on data security, reference may be made to the International 
Organization for Standardization (ISO) security architecture defined in section 5 of ISO/IEC 
7498-2, 1989.) As a minimum requirement for the teleradiology system of the invention, name 
and password are required to identify the authorized user 400 via user interface 32. Access 
privileges to the teleradiology system in general and to transmitting station 100 in particular are 
user specific. An audit trail of system resource usage, patient information access, etc. is provided. 
Encryption of demographics is employed. Firewalls are installed for Internet connections. Data 
security measures for the teleradiology system of tiie invention are similar to that for current 
teleradiology systems (refer to 34A and 32A in Fig. 2). 

With the above descriptions on data compression / decompression, data security 
measures, integration with data source and data management, transmission media and protocols, 
implementing the data transmission aspects of the teleradiology system of the invention should 
be clear to one with ordinary skill in the field. 

New functionalities and capabilities 
On-demand rendering / transmission control and Rendering remotely located volume data 
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The teleradiology system of Uie invention (Fig. 1) integrates the functionality of data 
transmission of current teleradiology systems and volume data rendering / visualization of 
current volume data rendering / visualization systems. In comparison, the current two-step 
approach discussed in the Background of the Invention simply installs an existing teleradiology 
system (i.e., receiving station 300A in Fig. 2) and an existing volume data rendering / 
visualization system on one computer. The teleradiology system of the invention, by true 
integration, provides new functionalities for on-demand rendering and transmission control and 
new capabilities for rendering and studying remotely located volume data. In comparison, these 
functionality and capability do not exist in the current two-step approach, i.e., via a simple 
combination. 

With these new functionalities and capabilities, user 400 can navigate through a remotely 
located volume data set, interactively define and adjust the rendering method and parameters, 
control what is to be rendered, transmitted and visualized next, and eventually obtain the final 
rendering result. Thus, user 400 can render and visualize a remotely located volume data set 
without transmitting the entire volume data set to tihe user's local computer. 

It is to be noted that though medical volume data sets are typically large in size (e.g., 150 
MB for a CT Angiography study), in many cases, the user may want to review intermediate and 
final rendering results only, which are usually much smaller (e.g., of a order of 1 MB) in size. 
Thus, compared to the current two-step approach, the teleradiology system of the invention 
greatly alleviates network speed limitations. Furthermore, it eliminates the long initial delay 
associated with transmitting a large data set over a network, and therefore rendering and 
visualization can be started ahnost immediately. It also avoids the problem of generating 
multiple copies of the data at different locations, which is often desirable for patient data 
management. With the teleradiology system of the mvention, the healthcare providers can 
further expand the geographic and/or time coverage of their service, resulting in improved 
healthcare service quality, delivery time, and patient data management, as well as reduced cost. 

Different divisions of the rendering generation task 
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As a preferred embodiment of the invention, the teleradiology system generates the data 
rendering result exclusively on transmitting station 100, and then transmits the rendering result to 
receiving station 300. Thus, the hardware (e.g., memory, storage, and computation) demanding 
operations (e.g., the volume rendering operation) can be performed exclusively on transmitting 
station 100. This embodiment allow^s a full utilization of the computer hardware capability at 
transmitting station 100, and therefore minimizes the hardware requirements on receiving station 
300. As a result, users can perform advanced volume data rendering and visualization even with 
the most basic local computers as receiving stations 300. 

hi another embodiment of the mvention, transmitting station 100 only does a partial 
computation (e.g., generating a surface rendering model). Central processing system 24 on 
receiving station 300 completes the remaining part of the computation based on the partial 
computation done by transmitting station 100, and displays the final rendering result on user 
mterface 32 via display system 30. This embodiment may sometimes further reduce the network 
load by performing some computations on the user's local computer. 

Client-server software structure 

The teleradiology system of the invention uses client-server design architecture. (For 
technical details on client-server systems, refer to Dewire DT. Client/Server Computing, 
McGraw-Hill, 1993.) As a resxxlt, software of this system can be installed, maintained, and 
upgraded on one station, referred to as the software server, while the other station is referred to 
as the software client, hi a preferred embodiment, transmitting station 100 acts as the software 
server and receiving station 300 as the software client. The software for the software chent can 
be supplied by the software server via network 200 at each time of use. Altematively, it can be 
installed on the software client once and for future use. hi the latter case, the software client is 
notified, via network 200, when a software upgrade is available. The client-server software 
implementation greatly reduces the cost of hcensing as well as installing, maintaining, and 
upgrading software on each software client. The system of the invention also can charge the use 
of the system on either per license basis, per use basis, or other basis. 
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Web browser based client software 



As a preferred embodiment, the software to be run at receiving station 300 is developed 
based on standard Web browsers (e.g., Microsoft Explorer or Netscape Navigator). Specifically, 
the software for receiving station 300 can be a "plug-in" of the Web browser, which is installed 
once and is an integral part of the Web browser on receiving station 300. Alternatively, the 
software for receiving station 300 can be a Java applet, which is a program sent from transmitting 
station 1 00 each time the program is used. (For technical details on Java applet, refer to 
Horstmann CS, Cornell G. Core Java, Vol 1: Fundamentals, Sun Microsystems, 1998.) Using 
Web browser based software makes volume data rendering / visualization software available to 
any authorized user with a networked computer. Using Java based software makes it work on 
commonly used operation platforms (e.g., Unix and PC). 

The client-server implementation and Web browser based implementation make the 
proposed system very accessible. Any authorized user can perform advanced volume data 
rendering and visualization tasks from the user's preferred location using a networked computer. 
As an example, a user can perform advanced volume data rendering and visualization tasks even 
with the most basic local computers (e.g., the user's desktop computer) and even without the 
current volume data rendering / visualization software installed on the user's computer. 

hiterconnection of multiple receiving / transmitting stations 

Though only one receiving station 300 and one transmitting station 100 are shown in Fig. 
1, multiple receiving stations 300 can be connected to a transmitting station 100 and multiple 
transmitting stations 100 may be connected to a receiving station 300. Multiple receiving stations 
300 can operate individually, i.e., without interfering with each other. Altematively and as a 
special mode, some receiving stations may also operate in a collaborative (conference) mode so 
that the user input at, and the display on, one receiving station can be viewed by multiple 
receiving stations as a group. Furthermore, multiple computers may be used to collectively 
serve the fimction of one transmitting station 100. 
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Healthcare enterprise-w ide image distribution solution for images, information / data repository. 
and the electronic medical record 



Because it is extremely cost-effective, ubiquitously accessible, provides acceptable data 
security protection and data management, and significantly relaxes requirements on network as 
well as the user's local computer (software and hardware), the teleradiology system of the 
invention is well suited as a healthcare enterprise-wide image distribution solution. Furthermore, 
it can serve as an enterprise-wide PACS (Picture Archiving Communication System) and can be 
readily integrated with other PACS and image distribution systems. 

By greatly reducing the cost and drastically improving the accessibility of image 
distribution, the teleradiology system of the invention is a preferred image distribution method 
for medical image data, for medical information / data repository, and for the electronic medical 
record (or computerized patient record). Thus, it may be used in settings where the patient data 
contains not only image data but also other data (e.g ECG) and information (e.g., notes on patient 
medical history). 

hitegration and display of multiple rendering results 

The teleradiology system of the invention can be used for rendering and visualizing 
multiple images resulted fi:om different rendering methods and parameters, fi"om different data 
sets (regardless of whether they are locally or remotely located), and/or different image data 
acquisition methods (e.g. CT, MR, US). The rendering methods include volume data rendering 
as well as conventional 2D image rendering. The multiple displays may be updated individually 
or simultaneously. For example, images of axial, sagittal and coronal multiplaner reformation 
containing cursor position may be displayed and updated simultaneously as the cursor moves. 
Furthermore, maximum intensity projection, volume rendering, and/or, surface rendering results 
may be individually or simultaneously displayed and/or updated with axial, sagittal and/or 
coronal images, hi addition, results from different studies, be it from one or multiple image data 
acquisition method, can be individually or simultaneously displayed and/or updated for 
comparison. The different rendering results from different rendering methods, different 
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rendering parameters, different data sets, and/or different image data acquisition methods can be 
further combined to form one or multiple composite images. 

Operation modes and their selections 

The system may have many different operation modes. Examples of different operation 
modes that have been discussed in previous sections include the different divisions of the 
rendering generation task between receiving station 300 and transmitting station 100, different 
data compression / decompression operations with different data compression ratios, different 
data transmission modes for network 200. In general, the different operation modes also requu-e 
different software configurations. As exempUfied in previous discussions, the different 
operation modes may be selected either by user 400 via user interface 32, or by one or more 
automated computer program. Usmg software configurations as an example, the selection of 
software configurations can be accomplished with user intervention. Alternatively, software can 
automatically adjust its configuration based on, for example, the configuration of the 
teleradiology system (network and transmitting / receiving stations) as well as the data rendering 
task. For example, if the software detects that receiving station 300 has very basic hardware 
resources (in terms of memory, storage, and/or computation power) for the data rendering task, it 
automatically uses the software that performs data rendering exclusively on transmitting station 
100. 

Other embodiments 

Although in a preferred embodiment image data source 10 is accessed via transmitting 
station 100 and transmitting station 100 also acts as the software server, this invention also 
includes other embodiments. For example, in one embodiment image data source 10 is accessed 
via transmitting station 100, but receiving station 300 acts as the software server instead. In this 
case, transmitting station 100 will use the volume data rendering software provided by receiving 
station 300 via network 200 to generate the rendering result, partially or completely, on 
transmitting station 100. In another embodiment, transmittmg station 100 acts as the software 
server, but image data source 10 is located proximate to, and accessed via, receivmg station 300 
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instead. In this case, receiving station 300 will use the volume data rendering / visualization 
software provided by transmitting station 100 via network 200 to generate, completely on 
receiving station 300, the rendering result. 

Obviously, many other modifications and variations of the present invention are possible 
in light of the above teachings. It is therefore to be understood that within the scope of the 
disclosed concept, the invention may be practiced otherwise than as specifically described. 
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CLAIMS 



We claim: 

A system for accessing patient information and data stored electronically, comprising: 

at least one receiving station under the control of at least one user of said system; 

at least one transmitting station physically separated from said receiving station; 

at least one type of network connecting, and transmitting data between, said transmitting 
station and said receiving station; 

means for said system accessing at least one patient data source containing at least one 
patient volume data set acquired using at least one data acquisition method; and 

user interface means provided at said receiving station for enabling said user to specify at 
least one request of volume data rendering result, said request comprising specification of 
data rendering parameters of at least one volume data rendering method to be appUed on at 
least one radiological volume data set from said data source. 

The system of claim 1 further including: 

display means for presenting said rendering resuk and a plurality of said rendering parameters 
at said receiving station. 

The system of claim 1 further including: 

security and data management means for preventing an unauthorized user from gaining 
access to said data set from said system. 

The system of claim 3 wherein: 

said security and data management means further include means for employing firewalls 
during the data transmission and / or for encrypting demographic of said data set. 
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5. The system of claim 1 further including: 

Means included in said transmitting station for compressing data to be transmitted; 

means for transmitting said compressed data from said transmitting station to said receiving 
station through said network; and 

means included in said receiving station for decompressing said transmitted data. 

6. The system of claim 1 w^herein: 

said transmitting station includes means for computing at least a part of said rendering result, 
and said receiving station includes means for computing the remaining part of said rendering 
result. 



7. The system of claim 1 wherein: 

said system's software is installed, managed and upgraded at one of said stations, the 
software for the other station being alternatively supplied at each time of use over said 
network or on a permanent basis. 

8. The system of claim 1 fiirther including: 

management and software distribution means included in said system for charging the use of 
said system alternatively on per license basis or on per use basis. 

9. The system of claim 1 wherein: 
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said system has a plurality of operation modes, the particular operation mode used being 
altematively selected by said user through said user interface, or by an automated computer 
program. 

10. The system of claim 1 wherein: 

said receiving station is provided with software which is usable with a web browser. 

1 L The system of claim 1 wherein: 

said receiving stations comprises one of multiple receivmg stations interconnected by said 
network so that the input and the display at one of said receiving stations can be viewed by 
other of said receiving stations. 

12. The system of claim 1 further including: 

data transmission means for transmitting images with progressive refinement. 

13. The system of claim 1 wherein: 

said user interface means includes image processing tools and data editing tools for editing 
said data set. 

14. The system of claim 1 wherein: 
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the data transmission is controlled by the transmission parameters, said transmission 
parameters being alternatively selected by said user through said user interface, or by an 
automated program. 



15. The system of claim 5 wherein: 

said compressing means and decompressing means are operable in accordance with each of a 
plurality of compression / decompression methods, the particular method used being 
alternatively selected by said user through said user interface, or by an automated computer 
program. 



16. The system of claim 2 wherein: 



said user interface means comprises means for enabling said user 

to specify different data rendering requests resulting from different rendering parameters, 
different rendering methods, and / or different data sets from one or multiple data 
acquisition methods, and 

to specify a method to integrate said different data rendering results into at least one 
composite rendering result; and 

said display means for presenting at said receiving station said composite rendering result and 
a plurality of parameters used for generating said composite rendering result. 
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Abstract 



A teleradiology system provides the capability of rendering and studying of a remotely located 
volume data without requiring transmission of the entire data to the user's local computer. The 
system comprises: receiving station (300) under the control of a user (400); transmitting station 
(100); the connecting network (200); the user interface (32) with functionality of controlling 
volume data rendering, transmission, and display; and the interface with patient data source (10). 
The teleradiology system of the invention provides an integrated functionality of data 
transmission of current teleradiology systems and volume data rendering / visualization of 
current volume data rendering / visualization systems. The system may be readily used with an 
intranet, the mtemet (including the intemet2) or via a dkect dial-up using a telephone line with a 
modem, and can serve as an enterprise-wide PACS and may be readily integrated with other 
PACS and image distribution systems. Software of this system can be centrally installed and 
managed and can be provided to the user's local computer on an as-needed basis. Furthermore, 
the software for the user's computer is developed to use with standard web browser. This system 
provides a secure, cost-effective, wddely-accessible solution for data rendering and visualization. 
It provides a suitable image distribution method for medical image data, for medical data 
repository, and for the electronic medical record (or the computerized patient record). It allows 
healthcare providers (e.g., radiologists, other physicians, and supporting staffs) to render and 
study remotely located patient data at the locations of their choices. 
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PATENT APPLICATION DECLARATION 



As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, 
first and joint inventor (if plural names are listed below) of the subject matter which is claimed and for 
which a patent is sought on the invention entitled: Teleradiology Systems for Rendering and 
Visualizing Remotely Located Volume Data Sets, the specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the examination of this 
application in accordance with Title 37, Code of Federal Regulations, §1. 56(a). 



I hereby claim foreign priority benefits under Title 35, USC §119 of any foreign application for 
patent or inventor's certificate listed below, and have also identified below any foreign application for 
patent or inventor's certificate having a filing date before that of the application on which priority is claimed: 



COUNTRY 


APPLICATION NUMBER 


DATE OF FILING 
(day, month, year) 


PRIORITY CLAIMED 
UNDER 37 USC 119 
















□ Yes ONo 



I hereby claim the benefit under Title 35, United States Code, §120 of any United States 
application(s) listed below and, insofar as the subject matter of each of the claims of this application is not 
disclosed in the prior United States application in the manner provided by the first paragraph of Title 35, 
United States Code, §112, I acknowledge the duty to disclose material information as defined in Title 37, 
Code of Federal Regulations, §1 .56(a) which occurred between the filing date of the prior application and 
the national or PCT international filing date of this application: 



APPLICATION SER. NO. 


APPLICATION SER. NO. 


FILING DATE 


STATUS (patented, 
pending, abandoned) 











I hereby direct that all correspondence in connection with this application be addressed to Hui Hu, 
whose address is ImagingTech, Inc., 20720 W. Wateitown Road, Suite 201, Waukesha. Wisconsin 53186, and 
whose telephone number is (262) 798-9880. 

I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be tme; and further that all statements were 
made with the knowledge that willful false statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that all such willful 
false statements may jeopardize the validity of the application or any patent issued thereon. 
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Citizenship: USA 
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Residence: 2027 Ne\Arton Avenue, Shorewood, Wisconsin 5321 1 

^ Citizenship: Peoples Republic of China 
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